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DETAILED ACTION 

4 

1 . This action is responsive to communications: Application filed on 27 April 2006 

2. Claims 61-78 are pending in the case. Claims 61 , and 70 are independent 
claims. 

Applicant's Response 

3. In Applicant's response dated 27 April 2006, Applicant amended Claims 61 and 
70; argued against all objections and rejection previously set forth in previous Office 
Action. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 61, 62, and 71 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Maurille (Patent No.: 6,484,196 B1; Filing Date: Mar. 20, 1998) in 
view of Skelly (Patent No.: 6,064,383; Filing Date: Oct. 4, 1996). 

In regard to independent claim 61, Maurille discloses a method, comprising the 
steps of: 

receiving a set of sequences of keystrokes, mouse actions, or keystrokes and 
mouse actions (col. 2, lines 23-45; Maurille discloses Instant Messaging systems allow* 
users to communicate privately in real time over a network connections. Maurille further 
disclose Chat systems allow a group of users to enter a chat room and engage in a 
group conservation. It has been established and is well known in the art that 
communications is established among users within Instant Messaging system and Chat 
system by the system receiving a set of sequences of keystrokes, mouse actions, or 
keystrokes and mouse actions. ) . 
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Maurille does not disclose detecting whether a mnemonic name is present in said 
sequences of l<eystrokes, mouse actions, or keystrokes and mouse actions, said 
mnemonic name being associated with one of a set of multimedia objects; 

when said mnemonic name is detected in said set of sequences, replacing said 
mnemonic name with said multimedia object in said set of sequences: 

wherein said set of multimedia objects are associated with an ensemble, said 
ensemble having a set of ensemble properties. 

However, Skelly teaches detecting whether a mnemonic name is present in said 
sequences of keystrokes, mouse actions, or keystrokes and mouse actions, said 
mnemonic name being associated with one of a set of multimedia objects (col, 1 , line 
43-65; Skelly teaches the system searches the input text for emoticons, which are a 
series of characters that represent emotions. Skelly further teaches the system 
searches the input text to identify acronyms that may provide clues for the desired 
appearance for the character.). 

when said mnemonic name is detected in said set of sequences, replacing said 
mnemonic name with said multimedia object in said set of sequences (col. 1 , line 53-65; 
Skelly teaches the maintains a list of emotions, along with associated gestures and 
expressions, and acronyms. Upon finding an emotion or acronym, the system generates 
the appearance of the emotion for the character or the acronym for display. It has been 
established and it well known in the art that in displaying the emotions, along with 
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associated gestures and expressions, and acronyms the system substitutes the 
appropriate emoticon for the input text.). 

wherein said set of multimedia objects are associated witli an ensemble, said 
ensemble having a set of ensemble properties (col. 1 , line 53-54; col. 2, line 34-65; 
Skelly teaches a user interface element presents a user with a selection of possible 
emotions and intensities of emotions for a character that is assigned to the user.). 

Therefore at the time of the invention it would have been obvious to a person of 
ordinary skill in the art to combine Maurille with Skelly for the benefit of displaying 
emoticons during instant messaging and chat room conservations. 

In regard to dependent claim 62, Maurille does not expressly disclose a 

method as in claim 61] wherein said ensemble properties are effective to select among 
a set of alternative multimedia objects for each multimedia object in said set 

However, Skelly teaches a method as in claim 61, wherein said ensemble 
properties are effective to select among a set of alternative multimedia objects for each 
multimedia object in said set (col. 1 , line 53-65; col. 2, line 34-65; Skelly teaches the 
maintains a list of emotions, along with associated gestures and expressions, and 
acronyms. Skelly teaches a user interface element presents a user with a selection of 
possible emotions and intensities of emotions for a character that is assigned to the 
user.). 
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Therefore at the time of the invention it would have been obvious to a person of 
ordinary skill in the art to combine Maurille with Skelly for the benefit of displaying 
emoticoris during instant messaging and chat room conservations. 

In regard to dependent claim 71, Maurille does not expressly disclose a system 
as in claim 70, wherein said ensemble properties are effective to select among a set of 
alternative multimedia objects for each multimedia object in said set. 

However, Skelly teaches a method as in claim 61, wherein said ensemble 
properties are effective to select among a set of alternative multimedia objects for each 
multimedia object in said set (col. 1, line 53-65; col. 2, line 34-65; Skelly teaches the 
maintains a list of emotions, along with associated gestures and expressions, and 
acronyms. Skelly teaches a user interface element presents a user with a selection of 
possible emotions and intensities of emotions for a character that is assigned to the 
user.). 

Therefore at the time of the invention it would have been obvious to a person of 
ordinary skill in the art to combine Maurille with Skelly for the benefit of displaying 
emoticons during instant messaging and chat room conservations. . 
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6. Claims 63-70, and 72-78 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mauriile (Patent No.: 6,484,196 B1; Filing Date: Mar. 20, 1998) in 
view of Skelly (Patent No.: 6,064,383; Filing Date: Oct. 4, 1996) further in view of 
Liles et al. (Pat No.: 5,880,731 ; Filling Date Dec. 14, 1995) (hereinafter Tiles'). 

In regard to dependent claim 63, Mauriile in view of Skelly does not expressly 
disclose a method as in claim 61, wherein said ensemble properties include a theme, 
said theme being effective to select, for each multimedia object in said ensemble, one 
multimedia object from a set of multimedia objects associated with said theme. 

However, Liles teaches a method as in claim 61, wherein said ensemble 
properties include a theme, said theme being effective to select, for each multimedia 
object in said ensemble, one multimedia object from a set of multimedia objects 
associated with said theme (col. 1 , lines 52-54; Liles teaches in a graphical chat 
session, all of the participants are represented by avatars or icons are grouped in a 
graphic environment or world.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Mauriile in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 
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In regard to dependent claim 64, Maurille in- view of Skelly does not expressly 
disclose a method as in claim 61, wherein said ensemble properties are editable in 
response to a set of editing abbreviations. 

However, Liles teaches a method as in claim 61, wherein said ensemble 
properties are editable in response to a set of editing abbreviations (col. 7, lines 43-65; 
Liles teaches each avatar presented for selection in character selection dialog box 
corresponds to a different bitmap file. Each bitmap file contains a predefine number of 
frames in which the user is free to customize by opening the bitmap file within a paint 
program and modifying the expressions/gestures on the avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat . 
session (col. 6, lines 20-34).- 

In regard to dependent claim 65, Maurille in view of Skelly disclose a method 
as in claim 64, wherein each said editing abbreviation comprises a relatively short 
sequence of keystrokes or mouse actions (col. 1 , line 59-65; Skelly teaches upon 
finding LOL in the text, the system concludes that the character should be laughing and 
generates a laughing appearance for the character.). 

Therefore at the time of the invention it would have been obvious to a person of 
ordinary skill in the art to combine Maurille with Skelly for the benefit of displaying 
emoticons during instant messaging and chat room conservations. 
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In regard to dependent claim 66, Maurille discloses a method as in claim 61, 
further comprising the steps of: communicating at least one of said ensemble properties ' 
to a recipient with an electronic chat message or an electronic mail message (col. 2, 
lines 23-45; Maurille discloses Instant Messaging systems allow users to communicate 
privately in real time over a network connections. Maurille further disclose Chat systems 
allow a group of users to enter a chat room and engage in a group conservation.). 

Maurille in view of Skelly does not expressly presenting said multimedia object to 
said recipient in accordance with said at least one of said ensemble properties. 

However, Liles teaches presenting said multimedia object to said recipient in 
accordance with said at least one of said ensemble properties (col.-1 , lines 52-57; Liles 
teaches in a graphical chat session, all of the participants are represented by avatars or 
icons are grouped in a graphic environment or world. Liles further discloses a graphic 
window showing the chat world.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 67, Maurille does not disclose a method as in 
claim 66, further comprising the step of conditionally overriding at least one of said 
ensemble properties in response to a capability of said recipient's presentation device, 
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whereby said multimedia object is presented to said recipient in accordance with a 
different at least one of said ensemble properties. 

However, Liles teaches a method as in claim 66, further comprising the step of 
conditionally overriding at least one of said ensemble properties in response to a 
capability of said recipient's presentation device, whereby said multimedia object is 
presented to said recipient in accordance with a different at least one of said ensemble 
properties (col. 7, lines 43-65; Liles teaches each avatar presented for selection in 
character selection dialog box corresponds to a different bitmap file. Each bitmap file 
contains a predefine number of frames in which the user is free to customize by opening 
the bitmap file within a paint program and modifying the expressions/gestures on the 
avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 68, Maurille does not disclose a method as in 
claim 66, further comprising the step of conditionally overriding at least one of said 
ensemble properties in response to an action by said recipient, whereby said 
multimedia object is presented to said recipient in accordance with a different at least 
one of said ensemble properties. 
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However, Liles teaches a method as in claim 66, further comprising the step of 
conditionally overriding at least one of said ensemble properties in response to en- 
action by said recipient, whereby said^multimedia object is presented to said recipient in 
accordance with a different at least one of said ensemble properties (col. 7, lines 43-65; 
Liles teaches each avatar presented for selection in character selection dialog box 
corresponds to a different bitmap file. Each bitmap file contains a predefine number of 
frames in which the user is free to customize by opening the bitmap file within a paint 
program and modifying the expressions/gestures on the avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to sielect a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 69, Maurille in view of Skelly does not disclose a 
method as in claim 68, wherein said action includes time taken by said recipient to 
review the multimedia object. 

However, Liles teaches a method as in claim 68, wherein said action includes 
time taken by said recipient to review the multimedia object (col. 7, lines 18-21 ; Liles 
teaches a preview box for previewing the selected avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
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capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to independent claim 70, Maurille does not disclose a method 
system, comprising: 

a database tiaving a set of mnemonic names, each associated with at least one 
corresponding multimedia object (col. 1, line 53-65; Skelly teaches the maintains a list 
of emotions, along with associated gestures and expressions, and acronyms.). 

an input device for a set of sequences of keystrokes, mouse actions, or 
keystrokes and mouse actions (col. 1 , line 43-65; Skelly teaches the system searches 
the input text for emoticons, which are a series of characters that represent emotions. 
Skelly further teaches the system searches the input text to identify acronyms that may 
provide clues for the desired appearance for the character.). 

a detector capable of detecting at least one of said mnemonic names in said set 
of sequences and of replacing said mnemonic name with at least one corresponding 
multimedia object in said set of sequences (col. 1 , line 53-65; Skelly teaches the 
maintains a list of emotions, along with associated gestures and expressions, and 
acronyms. Upon finding an emotion or acronym, the system generates the appearance 
of the emotion for the character or the acronym for display. It has been established and 
it well known in the art that in displaying the emotions, along with associated gestures 
and expressions, and acronyms the system substitutes the appropriate emoticon for the 
input text.). 
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an associating mechanism capable of associating an ensemble with a set of said 
multimedia objects, said ensemble having a set of ensemble properties (col. 1 , line 53- 
54; col. 2, line 34-65; Skelly teaches a user interface element presents a user with a 
selection of possible emotions and intensities of emotions for a character that is 
assigned to the user.). 

Maurille in view of Skelly does not disclose wherein each said multimedia object 
has a set of editable properties. 

However, Liles teaches wherein each said multimedia object has a set of editable 
properties (col. 7, lines 43-65; Liles teaches each avatar presented for selection in 
character selection dialog box corresponds to a different bitmap file. Each bitmap file 
contains a predefine number of frames in which the user is free to customize by opening 
the bitmap file within a paint program and modifying the expressions/gestures on the 
avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 72, Maurille in view of Skelly does. not expressly a 
system as in claim 70, wherein said ensemble properties include a theme, said theme 
being effective to select, for each multimedia object in said ensemble, one multimedia 
object from a set of multimedia objects associated with said theme. 
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However, Liles teaches a system as in claim 70, wherein said ensemble 
properties include a theme, said theme being effective to select, for each multimedia 
object in said ensemble, one multimedia object from a set of multimedia objects 
associated with said theme (col. 1 , lines 52-54; Liles teaches in a graphical chat 
session, all of the participants are represented by avatars or icons are grouped in a 
graphic environment or world.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (coL 6, lines 20-34). 

In regard to dependent claim 73, Maurille in view of Skelly does not expressly 
disclose a system as in claim 70, wherein said ensemble properties are editable in 
response to a set of editing abbreviations. 

However, Liles teaches a system as in claim 70, wherein said ensemble 
properties are editable in response to a set of editing abbreviations (col. 7, lines 43-65; 
Liles teaches each avatar presented for selection in character selection dialpg box 
corresppnds to a different bitmap file. Each bitmap file contains a predefine number of 
frames in which the user is free to customize by opening the bitmap file within a paint 
program and modifying the expressions/gestures on the avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
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capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 74, Maurille in view of Skelly disclose a system 
as in claim 73, wherein each said editing abbreviation comprises a relatively short 
sequence of keystrokes or mouse actions (col. 1, line 59-65; Skelly teaches upon 
finding LOL in the text, the system concludes that the character should be laughing and 
generates a laughing appearance for the character.). 

Therefore at the time of the invention it would have been obvious to a person of 
ordinary skill in the art to combine Maurille with Skelly for the benefit of displaying 
emoticons during instant messaging and chat room conservations. 

In regard to dependent claim 75, Maurille discloses a system as in claim 70, 
further comprising: 

a communicating mechanism capable of sending at least one of said ensemble 
properties to a recipient with an electronic chat message or an electronic mail message 
(col. 2, lines 23-45; Maurille discloses Instant Messaging systems allow users to 
communicate privately in real time over a network connections. Maurille further disclose 
Chat systems allow a group of users to enter a chat room and engage in a group 
conservation.). 

Maurille in view of Skelly does not expressly a presentation mechanism capable 
of presenting said multimedia objects to said recipient in accordance with said at least 



Application/Control Number: 10/764,835 Page 16 

Art Unit: 2176 

one of said ensemble properties. 

However, Liles teaches a presentation mechanism capable of presenting said 
multimedia objects to said recipient in accordance witti said at least one of said 
ensemble properties (col. 1, lines 52-57; Liles teaches in a graphical chat session, all of 
the participants are represented by avatars or icons are grouped in a graphic 
environment or world. Liles further discloses a graphic window showing the chat world.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 76, Maurille in view of Skelly does not expressly a 
system as in claim 75, further comprising a mechanism capable of conditionally 
overriding at least one of said ensemble properties in response to a capability of said 
recipient's presentation device, whereby said multimedia objects are presented to said 
recipient in accordance with a different at least one of said ensemble properties. 

However, Liles teaches a system as in claim 75, further comprising a mechanism 
capable of conditionally overriding at least one of said ensemble properties in response 
to a capability of said recipient's presentation device, whereby said multimedia objects 
are presented to said recipient in accordance with a different at least one of said 
ensemble properties (col. 7, lines 43-65; Liles teaches each avatar presented for 
selection in character selection dialog box corresponds to a different bitmap file. Each 
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bitmap file contains a predefine number of frames in which the user is free to customize 
by opening the bitmap file within a paint program and modifying the 
expressions/gestures on the avatar.). 

Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 77, Maurille in view of Skelly does not expressly a. 
system as in claim 75, further comprising a mechanism capable of conditionally 
overriding at least one of said ensemble properties in response to an action by said 
recipient, whereby said multimedia objects are presented to said recipient in 
accordance with a different at least one of said ensemble properties. 

However, Liles teaches a system as in claim 75, further comprising a mechanism 
capable of conditionally overriding at least one of said ensemble properties in response 
to a capability of said recipient's presentation device, whereby said multimedia objects 
are presented to said recipient in accordance with a different at least one of said 
ensemble properties (col. 7, lines 43-65; Liles teaches each avatar presented for 
selection in character selection dialog box corresponds to a different bitmap file. Each 
bitmap file contains a predefine number of frames in which the user is free to customize 
by opening the bitmap file within a paint program and modifying the 
expressions/gestures on the avatar). 
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Therefore it would have been obvious to a person of ordinary skill in the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

In regard to dependent claim 78, Maurille in view of Skelly does not expressly a 
system as in claim 77, wherein said action comprises time tal<en by said recipient to 
review the multimedia objects. 

However, Liles teaches a system as in claim 77, wherein said action comprises 
time taken by said recipient to review the multimedia objects (col. 7, lines 1 8-21 ; Liles 
teaches a preview box for previewing the selected avatar.). 

Therefore it would have been obvious to a person of ordinary skilhin the art to 
combine Maurille in view of Skelly with Liles for the benefit of allowing the user the 
capability to select a particular theme, depending on the subject matter of the chat 
session (col. 6, lines 20-34). 

Response to Arguments 

7. Applicant's arguments, see Remarks, filed 27 April 2006, with respect to the 
rejection(s) of claim(s) 61-78 have been fully considered and are persuasive. 
Therefore, the rejection has been withdrawn. However, upon further consideration, a 
new ground(s) of rejection is made in view of Maurille, Skelly and Liles. 
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Conclusion 



8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James J. Debrow whose telephone number is 571-272- 
5768. The examiner can normally be reached on 8:00-5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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